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DESCRIPTION 



MULTI-COLOR TWO-DIMENSIONAL BAR CODE, AND ITS IMAGE DISPLAY 
DEVICE, INFORMATION TERMINAL DEVICE 

5 

This application is a U.S. national phase application of PCT 
International AppUcation PCT/JP2005/0 13777. 

TECHNICAL FIELD 

The present invention relates to a multi color two-dimensional bar code, 

10 and an image display device for displaying the multi-color two-dimensional bar 
code, an information terminal device for decoding information from the multi- 
color two-dimensional bar code, a method for displaying the multi-color two- 
dimensional bar code, a method for decoding the multi color two-dimensional bar 
code, an information communication system using the multi-color two- 

15 dimensional bar code, and an information communication method. In particular, 
when a television screen is photographed by a portable information terminal, the 
present invention improves an information recognition rate on the portable 
information terminal by optimizing the tint of the screen. 



20 BACKGROUND ART 

Among methods for taking out data information from picture images 
photographed by a portable information terminal, a means capable of 
transmitting a large amount of information includes a method of photographing 
two-dimensional bar code information displayed on a television screen, reading 

25 (decoding) the picture image data on the portable information terminal and 
extracting them as data. The portable information terminal stores the 
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information in the portable information terminal itself and uses it. 

Since this two-dimensional bar code is capable of recording a large 
amount of information by disposing points having a predetermined size in matrix, 
it is necessary to read out a recording position of each point exactly. Therefore, 
5 also in the portable information terminal, it is required that the two-dimensional 
bar code is photographed exactly when it is photographed by a camera. 

Furthermore, in a binary two-dimensional bar code using only two colors 
of white and black, only "0" and "1" of dot can be expressed by one dot. 
Therefore, in order to further increase the amount of information, besides a 
10 conventional method composed of two kinds of dots of white and black, a "multi- 
valued type two-dimensional bar code" method composed of colors such as red, 
blue and green, which are not limited to white or black, has been investigated. 

However, with a display driving device of a conventional Internet 
television, even when a multi valued type two-dimensional bar code is 
15 photographed by a portable information terminal, depending upon expression of 
the tints of a display driving device, when information is obtained on the portable 
information terminal, data cannot be read correctly. 



SUMMARY OF THE INVENTION 
20 The present invention is intended to address the above-mentioned 

problem, and it is an object of the present invention to allow a two-dimensional 
bar code displayed on an Internet television to be excellently readable as data 
when it is photographed by a portable information terminal. 

In order to dissolve this problem, in the present invention, a part of dots 
25 of a multi color two-dimensional bar code include reference dots showing the tint 
and/or compare dots showing the number of tints used for the bar code. 

According to the present invention, image quahty of the two-dimensional 
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bar code displayed on an Internet television is clearer than a conventional image 
quality, a television screen can be photographed by a portable information 
terminal more clearly, and the rate of recognizing information from the portable 
information terminal is improved. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. lA illustrates a kind of bar code in accordance with a first exemplary 
embodiment of the present invention. 

Fig. IB illustrates a kind of bar code in accordance with a first exemplary 
10 embodiment of the present invention. 

Fig. IC illustrates a kind of bar code in accordance with a first exemplary 
embodiment of the present invention. 

Fig. 2 is a conceptual block diagram showing a display driving device in 
accordance with the first exemplary embodiment of the present invention. 
15 Fig. 3 is a conceptual diagram showing a communication between a 

display driving device and an information portable terminal in accordance with 
first to third exemplary embodiments of the present invention. 

Fig. 4 is a view to illustrate a bar code in accordance with second and 
third exemplary embodiments of the present invention. 
20 Fig. 5 is a conceptual block diagram showing a display driving device in 

accordance with the second exemplary embodiment of the present invention. 

Fig. 6 is a flowchart showing action and operation of the display driving 
device and the portable information terminal in accordance with the second 
exemplary embodiment of the present invention. 
25 Fig. 7 is a conceptual block diagram showing a display driving device in 

accordance with the third exemplary embodiment of the present invention. 

Fig. 8 is a flowchart showing action and operation of the display driving 
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device and the portable information terminal in accordance with the third 
exemplary embodiment of the present invention. 

Fig. 9 is a block diagram showing a configuration of a portable 
information terminal in accordance with the first exemplary embodiment of the 
5 present invention. 

Fig, 10 is a block diagram showing a configviration of a portable 
information terminal in accordance with the second and third exemplary 
embodiments of the present invention. 

10 DET^im)DESC3l[PTIONOFTH^ 

Hereinafter, specific Examples are described, but various modifications 
can be carried out within the scope of the present invention. 
(FIROT EXEMPLARY EMBODI^^ 

Hereinafter, a first exemplary embodiment of the present invention is 
15 described with reference to Figs. lA to IC, Fig. 2 and Fig. 3. 

In the following description, well-known functions that are necessary to 
Examples of the present invention and that are already known in the field of the 
art of the present invention are not described herein unless they are necessary 
portions for description of the present invention. 
20 The kinds of bar codes are described with reference to Figs. lA to IC. 

Figs. lA to IC show examples of bar codes. 

In a one -dimensional bar code, as shown in Fig. lA, bars and space are 
arranged one-dimensionally. 

As shown in Fig. IB, a two-dimensional bar code is a matrix tjrpe two- 
25 dimensional bar code. 

Furthermore, Fig. IC shows a two-dimensional bar code using many 
colors that are not limited to two colors of white and black, which is referred to as 
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"multi-color two-dimensional bar code" hereinafter. 

The mvdti-color two-dimensional bar code in accordance with the present 
invention includes tint reference dots in a multi-color two-dimensional bar code. 

In an example shown in Fig, IC, a multi-color two-dimensional bar code is 
5 composed of three colors such as red, green and blue and includes "tint reference 
dots" for reference when a display is driven. 

In the first exemplary embodiment, since one dot includes three values 
(red, green and blue), the tint reference dots are composed of three dots and each 
dot expresses each of the three values (red, green and blue), respectively. 
10 In the present invention, the position of the tint reference dots is not 

particularly Umited to this position, but it may be located anywhere as long as it 
is located in the multi-valued two-dimensional bar code. 

In the present invention, colors used in the multi-color two-dimensional 
bar code are not limited to the above-described three colors but any numbers of 
15 colors may be used. In this case, the tint reference dots having the same number 
as that of the colors used in the multi-color two-dimensional bar code are 
included. 

In a method of arranging dots of the respective colors of the multi-color 
reference dots in the present invention, red dot, green dot and blue dot are 
20 arranged in longitudinal hne in this order. However, the order of arranging dots 
is not particularly limited and they may be arranged in any arrangement. 

Fig. 2 is a conceptual block diagram showing a display driving device 
(which corresponds to "image display device" in the present invention) including a 
tint adjusting means in accordance with the first exemplary embodiment of the 
25 present invention. 

Driving device 200 of the present invention includes controller 201 for 
controlling the operation of each constituent element of driving device 200 by an 
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already coded program, communication part 208 for establishing the 
communication between driving device 200 and the Internet, and display buffer 
202 for temporarily storing pictiu-e image data of information obtained by the 
control of driving device 200 via communication part 208 such as a web page. 
5 Herein, display buffer 202 stores a multi-color two-dimensional bar code 

obtained via the Internet. 

Furthermore, driving device 200 includes video memory 203 for storing 
picture image data and further includes RAMDAC (Random Access Memory 
Digital to Analog Converter) 206 for converting digital data read out from 

10 memory 204 into analog signals and outputting them onto display output device 
205 of the Internet television. 

In tint adjusting part 209, by referring to the tint reference dots of the 
multi-color two-dimensional bar code, the tint of the picture image part including 
at least the multi-color two-dimensional bar code is adjusted so that color signals 

15 R (red), G (green) and B (blue) in the input tint reference dots become output 

balance values that were prepared in advance. Then, the adjusted color signals 
R, G and B are output to RGB drive circuit 207. 

In RGB drive circuit 207, color signals R (red), G (green) and B (blue) are 
ampUfied and output to display output device 205. 

20 Note here that tint adjusting part 209 described herein corresponds to a 

"tint control part" in the present invention. 

Fig. 9 is a block diagram showing a configuration of portable information 
terminal 500 for photographing a multi color two-dimensional bar code displayed 
on display output device 205 of driving device 200 and decoding information 

25 therefrom. 

In Fig. 9, camera part 501 photographs an image. Bar code processing 
part 502 recognizes a bar code from the image photographed by camera part 501 
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and decodes information from this bar code. Then, in tint correcting part 503, by 
referring to the tint shown by the reference dots of the multi-color two- 
dimensional bar code contained in the image photographed by camera part 501, 
the tint of the photographed image is corrected. 
5 For example, in the first exemplary embodiment, the reference dots 

include three values of red, blue and green. However, depending upon the 
performance of camera part 501 of portable information terminal 500, these 
cannot be often recognized as red, blue and green. In this case, if the reference 
dots are already determined to be expressed by the three values of red, blue and 
10 green in portable information terminal 500, red, blue and green colors which were 
stored in advance can be compared with red, blue and green colors which are 
recognized from the reference dots so as to correct the tint of the picture image 
containing a multi-color two-dimensional bar code. 

Thus, the recognition rate of the multi color two-dimensional bar code by 
15 portable information terminal 500 can be improved. 

Fig. 3 is a view to illustrate a system for transmitting/receiving data 
to/from the portable information terminal for photographing picture image data 
from a television screen and obtaining information. 

Fig. 3 shows display device 301 of an Internet television and enlarged 
20 view 302 of a multi-color two-dimensional bar code displayed on display device 
301, as well as portable information terminal 303 and enlarged view 304 of a 
multi-color two-dimensional bar code displayed on a screen of portable 
information terminal 303. 

Firstly, on a screen of display device 301 of the Internet television, a 
25 picture image of a multi-color two-dimensional bar code is output to be displayed. 

Subsequently, a picture image photographed by attachment camera part 
305 of portable information terminal 303 disposed in the direction of the picture 
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image is shown in screen 304 of portable information terminal 303 although 
depending upon the performance of camera 305 of portable information terminal 
303. 

At this time, on display device 301, a picture image adjusted by tint 
5 adjusting part 209 is output. Since picture image 302 is output on a display in 
three colors, picture image data can be obtained also in three colors on a screen of 
the portable information terminal. 

Subsequently, in portable information terminal 303, in an arithmetic 
processing circuit (corresponding to bar code processing part 502 shown in Fig. 9) 
10 inside portable information terminal 303, color information of the multi color two- 
dimensional bar code are converted into data information having three values per 
dot of information, so that data can be obtained correctly. 

Since the tint of the recognized multi-color two-dimensional bar code is 
corrected by a tint correction circuit (tint correcting part 503 shown in Fig. 9) 
15 inside portable information terminal 303, even if the tint reproducibility of 

attachment camera part 305 (camera part 501 in Fig. 9) in portable information 
terminal 303 is low, it is possible to obtain data correctly. 
(SECOND EXEMPLARY EMBODIMENT) 

Hereinafter, a second exemplary embodiment of the present invention is 
20 described with reference to Figs. 3, 4, 5 and 6. 

Fig. 3 is a view to illustrate a system for transmitting/receiving data 
to/from the portable information terminal for photographing picture image data 
from a television screen and obtaining information in accordance with the second 
exemplary embodiment of the present invention. 
25 Fig. 4 shows a multi-color two-dimensional bar code in accordance with 

second exemplary embodiment of the present invention. Multi-color two- 
dimensional bar code 401 has compare dots 403 in addition to tint reference dots 
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402. 

Tint reference dot 402 is the same as that described in the first exemplary 
embodiment. 

Compare dots 403 are dots expressed by two values of white and black 
5 and the number of colors used in multi-color two-dimensional bar code picture 
image 401 is expressed by two values. For example, when six colors are used, it 
is described as "0110." 

Fig. 5 is a conceptual block diagram showing display driving device 520 of 
the Internet television in accordance with the second exemplary embodiment of 
10 the present invention. This block diagram includes switch 511 that can be 

operated from the outside and signal 512 transmitted when switch 511 is pushed 
in addition to the block diagram described in the first exemplary embodiment of 
the present invention. Other elements in Fig, 5 are substantially the same as 
those in Fig. 2 in the first exemplary embodiment and so the description therefor 
15 is omitted herein. 

Fig. 10 is a block diagram showing a configuration of portable information 
terminal 700 for photographing a multi color two-dimensional bar code displayed 
on display output device 525 of driving device 520 to decode information 
therefirom. 

20 In Fig. 10, notification part 704 notifies a failure in recognition of a bar 

code by bar code processing part 702. For example, when the nimiber of tints 
shown by the compare dots does not match to the number of tints appearing in 
the reference dots of the photographed multi-color two-dimensional bar code, 
notification part 704 notifies the failure in recognition of a bar code to the outside. 

25 In the second exemplary embodiment, the number of tints shown by the 

compare dots and the number of tints appearing in the reference dots are 
compared with each other, however, the number of tints shown in the compare 
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dots can be compared with the number of tints used in the entire multi-color two- 
dimensional bar code. 

Examples of notifying means may include displaying notification 
additionally on a display screen of portable information terminal 700, issuing an 
5 alert beep, flashing LED, and the hke. However, the means is not particularly 
limited thereto. 

Other elements in Fig. 10 are substantially the same as those shown in 
Fig. 9, and so the description therefor is omitted herein. 

Driving device 520 and portable information terminal 700 in accordance 
10 with the second exemplary embodiment acts and operates in accordance with a 
flowchart shown in Fig. 6. 

The action is described sequentially with respect to Fig. 6. 

Firstly, a picture image of the multi-color two-dimensional bar code is 
output to be displayed on a screen of display device 301 (corresponding to driving 
15 device 502 in Fig. 5) of the Internet television (S601). 

Subsequently, the picture image is photographed by attachment camera 
part 305 (corresponding to camera part 701 in Fig. 10) of portable information 
terminal 303 (corresponding to portable information terminal 700 in Fig. 10) by 
disposing it in the direction of the picture image (S602). Herein, a case where 
20 the photographed picture image can be recognized with only fewer colors than the 
number of colors of picture image 302, although depending upon the performance 
of attachment camera part 305 of portable information terminal 303, is 
considered. 

An example of such a case includes a case where on display device 301, a 
25 picture image adjusted by tint adjusting part 529 is output and picture image 302 
is output on a display in three colors, but it is displayed in only two colors on 
portable information terminal 303. At the side of display device 301, information 



11 

of the multi-color two-dimensional bar code has three values per dot of 
information. While, portable information terminal 303 can receive only two 
values per dot of information. 

Then, when portable information terminal 303 examines the compare 
5 dots, they have two gray scale, white and black. Therefore, for example, data 
"Oil" can be obtained securely and the number of colors of 3 can be obtained from 
the compare dots. 

Portable information terminal 303 determines whether the number of 
colors: 3 obtained from the compare dots matches to the number of colors^ 2 

10 obtained from the tint reference dots (S603). 

When they match to each other, the step determines that data can be 
obtained correctly, that is, "succeed in obtaining" and the step goes to the 
following step (S604). When they do not match to each other, since data showing 
wrong number of colors are insignificant, "determination of failure in recognition" 

15 is notified to a user of portable information terminal 303 by outputting 

notification on the screen of portable information terminal 303 or issuing some 
sound, and the like (S605). 

When a user receives the notification of "determination of failure in 
recognition," the user sends instruction for changing the tint to tint adjusting part 

20 529 via controller 521 by operating the main body of display device 301 or by 
operating a remote control (S606). 

When tint adjusting part 529 receives the instruction for changing the 
tint, it changes output balance values of color signals R (red), G (green) and B 
(blue) so that the balance value becomes different from the previous one, for 

25 example, so that contrast is higher (S607). Then, a picture image, in which the 
change was reflected, is output to display output device 525 and thus carries out 
feedback with respect to the failure in recognition. 
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Note here that in the second exemplary embodiment of the present 
invention, a case where the compare dots are composed of two values of white and 
black and have the number of dots of three was explained. However, the 
compare dots are not limited thereto and any multi-valued expression by any 
5 colors and any number of dots may be employed as long as the number of colors 
used in the multi-color two-dimensional bar code can be expressed. 

With such a configuration, even when data of the multi-color two- 
dimensional bar code fi'om the display device failed in being recognized on the 
portable information terminal, by changing the tint of the output picture image of 
10 the television screen, possibility of success in recognition can be increased. 
(THIRD EXEMPLARY EMBODIMENT) 

Hereinafter, a third exemplary embodiment of the present invention is 
described with reference to Figs. 3, 4, 7 and 8. 

Fig. 3 shows a system for transmitting/receiving data to/from portable 
15 information terminal obtaining information by photographing picture image data 
from the television screen in accordance with the third exemplary embodiment of 
the present invention. 

Fig. 4 shows a multi-color two-dimensional bar code in accordance with 
the third exemplary embodiment of the present invention. The description of the 
20 tint reference dots is the same as that in the first exemplary embodiment and the 
description of the compare dots is the same as that in the second exemplary 
embodiment. 

Fig. 7 is a conceptual block diagram showing display driving device 900 of 
the Internet television. Display driving device 900 includes photo receiving part 
25 912 capable of receiving infi-ared ray signal 910 and infrared hght fi:om the 
outside in accordance with the third exemplary embodiment of the present 
invention in addition to the block diagram illustrated in the first exemplary 
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embodiment of the present invention. Other elements in Fig. 7 are substantially 
the same as those in Fig. 2 of the first exemplary embodiment, and so the 
description therefor is omitted herein. 

Ftirthermore, in the third exemplary embodiment, the configuration of 
5 portable information terminal 700 is the same as that described in Fig, 10 of the 
second exemplary embodiment. When the number of tints shown by the 
compare dots does not match to the number of tints appearing in the reference 
dots, notification part 704 notifies a failure in recognition of a bar code. 

In the third exemplary embodiment, the number of tints shown by the 
10 compare dots and the number of tint appearing in the reference dots are 

compared with each other, however, the number of tints shown in the compare 
dots can be compared with the number of tints used in the entire multi-color two- 
dimensional bar code. 

In the third exemplary embodiment, notification part 704 notifies the 
15 failure in recognition of a bar code to the outside (infrared Ught receiving part 912 
of display driving device 900) by way of an infi-ared communication. 

Furthermore, a system for transmitting/receiving data to/from portable 
information terminal 700 obtaining information by photographing picture image 
data of the display output device 905 in accordance with the third exemplary 
20 embodiment of the present invention acts in accordance with the flowchart shown 
in Fig. 8. 

The action is described sequentially with reference to Fig. 8. 

Firstly, a picture image of the mtdti-color two-dimensional bar code is 
output to be displayed on a screen of display device 301 (corresponding to driving 
25 device 900 in Fig, 7) of the Internet television (S801), Subsequently, the picture 
image is photographed by attachment camera part 305 (corresponding to camera 
part 701 in Fig. 10) of portable information terminal 303 (corresponding to 
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portable information terminal 700 in Fig. 10) by disposing it in the direction of the 
picture image (S802), Herein, a case where the photographed picture image can 
be recognized with only fewer colors than the number of colors of picture image 
302, although depending upon the performance of attachment camera part 305 of 
5 portable information terminal 303, is considered. 

An example of such a case includes a case where on display device 301, a 
picture image adjusted by tint adjusting part 529 is output and picture image 302 
is output on a display in three colors, but it is displayed in only two colors on 
portable information terminal 303. At the side of display device 301, information 

10 of the multi-color two-dimensional bar code has three values per dot of 

information. While, portable information terminal 303 can receive only two 
values per dot of information. 

Then, when portable information terminal 303 examines the compare 
dots, they have two gray scales, white and black. Therefore, for example, data 

15 "Oil" can be obtained securely and the number of colors of 3 can be obtained from 
the compare dots. 

Portable information terminal 303 determines whether the number of 
colors^ 3 obtained from the compare dots match to the number of colors- 2 
obtained from the tint reference dots (S803). 

20 When they match to each other, the step determines that data can be 

obtained correctly, that is, "succeed in obtaining" and the step goes to the 
following step (S804). When they do not match to each other, since data showing 
wrong number of colors are insignificant, "determination of failure in recognition" 
signal 910 is sent to infrared Ught receiving part 912 of display device 301 

25 (corresponding to display driving device 900 in Fig. 7) from an infrared 

communication part (corresponding to notification part 704 in Fig. 10) of portable 
information terminal 303 (S805). 
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When display device 301 receives "determination of failure in recognition" 
signal 910 (S806), it sends instruction for changing the tint 911 to tint adjusting 
part 909 via controller 901. 

When tint adjusting part 909 receives the instruction for changing the 
5 tint 911, it changes output balance values of color signals R (red), G (green) and B 
(blue) so that the balance value becomes different from the previous one, for 
example, so that contrast is higher (S807). Then, an image is output to display 
output device 905 and thus carries out feedback with respect to the failure in 
recognition. 

10 Note here that the third exemplary embodiment of the present invention 

described a case where the number of dots of the compare dots is three. 
However, the number of dots is not Umited thereto and any number of dots may 
be employed as long as it can express the nxmaber of colors used in the multi-color 
two-dimensional bar code. 

15 With such a configuration, even when data of a multi color two- 

dimensional bar code from the display device cannot be recognized on the portable 
information terminal successfully, instruction for changing the tint of output 
picture image of a television screen again for a short time. As a result, the 
probability of success in recognition can be increased, 

20 

INDUSTRIAL APPLICABILITY 

A multi-color two-dimensional bar code, an image display device for 
displaying the multi-color two-dimensional bar code, an information terminal 
device for decoding information from the multi-color two-dimensional bar code, a 
25 method for displaying the multi color two-dimensional bar code, a method for 
decoding the multi-color two-dimensional bar code, an information 
communication system using the multi-color two-dimensional bar code and a 
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information communication method of the present invention have an effect 
capable of making the quality of image of a two-dimensional bar code to be 
displayed on the Internet television clearer than a conventional image quaUty, 
capable of photographing a television screen more clearly from a portable 
information terminal, and improving the information recognition rate by the 
portable information terminal. Furthermore, the present invention is useful in 
the field of a display of the Internet television, in particular, in the field in which 
the television screen is photographed by a portable information terminal and 
information is recognized on the portable information terminal. 



